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Abstract 

We  establish  heavy  traffic  limit  theorems  for  queue-length  processes  in  critically  loaded 
single  class  queueing  networks  with  state-dependent  arrival  and  service  rates.  A  distin¬ 
guishing  feature  of  our  model  is  non-Markovian  state  dependence.  The  limit  stochastic 
process  is  a  continuous-path  reflected  process  on  the  nonnegative  orthant.  We  give  an 
application  to  generalised  Jackson  networks  with  state-dependent  rates. 
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weak  convergence 
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1  Introduction 

Queueing  systems  with  arrival  and  (or)  service  rates  depending  on  the  system’s  state  arise 
in  various  application  areas  which  include  manufacturing,  storage,  service  engineering,  and 
communication  and  computer  networks.  Longer  queues  may  lead  to  customers  being  dis¬ 
couraged  to  join  the  queue,  or  to  faster  processing,  e.g.,  when  human  servers  are  involved. 

*  E-mail:  chihoon@stat.colostate.edu 
i  E-mail :  anatolii . puhalskii@ucdenver . edu 
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State-dependent  features  are  present  in  congestion  control  protocols  in  communication  net¬ 
works,  such  as  TCP  (see  [1,  3,  12,  14,  19]  and  references  therein  for  more  detail). 

In  this  paper,  we  consider  an  open  network  of  single  server  queues  where  the  arrival  and 
service  rates  depend  on  the  queue  lengths.  The  network  consists  of  K  single-server  stations 
indexed  1  through  K .  Each  station  has  an  inhnite  capacity  buffer  and  the  customers  are 
served  according  to  the  £rst-in-£rst-out  discipline.  The  arrivals  of  customers  at  the  stations 
occur  both  externally,  from  the  outside  and  internally,  from  the  other  stations.  Upon  service 
completion  at  a  station,  a  customer  is  either  routed  to  another  station  or  exits  the  network. 
Every  customer  entering  the  network  eventually  leaves  it.  A  distinguishing  feature  of  the 
model  is  non-Markovian  state  dependence.  More  specihcally,  the  number  of  customers  at 
station  i,  where  i  =  1,  2, . . . ,  iP,  is  governed  by  the  following  equations 

Qi{t)  =Qi(0)  +  Ai{t)  +  Bi{t)  —  Di(t), 

A,{t)  =Nf‘  A,(0(s))*])  , 

“  fl  1) 

1  =  1 

A(t)  =A'f  /ii(Q(s))l{Q^(,)>o}ds^  , 

where  Q{s)  =  (Qi(<s), . . . ,  Qk{,s))  denotes  the  vector  of  the  queue  lengths  at  the  stations  at 
time  s .  The  quantities  Nf(t)  and  N^it)  represent  the  number  of  exogeneous  arrivals  and 
the  maximal  number  of  customers  that  can  be  served,  respectively,  at  station  i  by  time  t 
under  “nominal”  conditions,  denotes  the  number  of  customers  routed  from  station 

j  to  station  i  out  of  the  £rst  m  customers  served  at  station  j  ,  and  \i{Q{t))  and  HiiQit)) 
represent  instantaneous  exogenous  arrival  and  service  rates,  respectively,  for  station  i  at 
time  t  given  the  queue  length  vector  Q(t) .  Thus,  Ai(t)  represents  the  cumulative  number 
of  exogeneous  arrivals  by  time  t  at  station  i,  Di{t)  represents  the  cumulative  number  of 
departures  by  time  t  from  station  i ,  and  Bi{t)  represents  the  cumulative  number  of  customers 
routed  to  station  i  from  the  other  stations  by  time  t.  The  quantities  Qi(0),  Nf-(t),  Nfit), 
and  are  referred  to  as  network  primitives.  Generalised  Jackson  networks  is  a  special 

case  of  (1.1)  where  the  and  are  renewal  processes,  the  are  Bernoulli  processes, 
and  Ai(-)  =  /ii(-)  =  1 . 

Our  goal  is  to  obtain  limit  theorems  in  critical  loading  for  the  queue  length  processes  akin 
to  di£usion  approximation  results  available  for  generalised  Jackson  networks,  see  Reiman 
[18].  The  results  on  the  heavy  traffic  asymptotics  for  state-dependent  rates  available  in  the 
literature  are  mostly  conhned  to  the  case  of  dffiusion  limits  for  Markovian  models,  see  Ya- 
mada  [20],  Mandelbaum  and  Pats  [14],  and  Chapter  8  of  Kushner  [12].  Yamada  [20]  and 
Mandelbaum  and  Pats  [14],  building  on  the  work  of  Krichagina  [10]  who  studied  a  Markovian 
closed  network  with  state-dependent  rates,  considered  a  case  of  the  model  (1.1)  where  the 
primitive  arrival  and  service  processes  are  standard  Poisson.  Kushner  [12]  also  includes  a 
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treatment  of  that  model  (see  Theorem  2.1  on  p.318),  however,  their  basic  model  is  formu¬ 
lated  in  terms  of  the  conditional  distributions  of  the  interarrival  (or  service)  intervals  (or 
the  routing),  given  the  “past”.  Those  authors  obtain  results  in  which  the  drift  coefficients 
of  the  limit  diffusion  processes  are  state-dependent  and  the  diffusion  coefficients  may  be 
either  constant  or  state-dependent,  which  is  determined  by  the  scaling  used.  Yamada  [20] 
and  Kushner  [12]  assume  critical  loading  and  obtain  mostly  diffusions  with  state-dependent 
diffusion  coefficients,  although  Yamada  [20]  considers  an  example  with  a  constant  diffusion 
coefficient  where  the  drift  has  to  be  linear  and  Theorem  2.1  on  p.318  of  Kushner  [12]  con¬ 
cerns  the  case  of  constant  diffusion  coefficients,  whereas  Mandelbaum  and  Pats  [14]  do  not 
restrict  their  analysis  to  critical  loading  and  their  limits  have  constant  diffusion  coefficients. 
Mandelbaum  and  Pats  [14]  and  Kushner  [12]  also  allow  the  process  of  routing  the  customers 
inside  the  network  to  be  state-dependent,  however,  their  reasonings  seem  to  be  unsubstanti¬ 
ated,  as  discussed  in  Section  2.  Section  7  of  Yamada  [20]  is  concerned  with  a  non-Markovian 
case  where  the  processes  Nf"  are  standard  Poisson,  the  processes  are  renewal  processes, 
and  iXi{  )  =  1.  It  is  also  mentioned  that  an  extension  to  the  case  of  renewal  arrivals  with 
Aj(-)  =  1  and  standard  Poisson  processes  is  possible. 

The  main  contribution  of  this  piece  of  work  is  incorporating  general  arrival  and  service 
processes.  This  is  achieved  by  applying  an  approach  different  from  the  one  used  by  Yamada 
[20],  Mandelbaum  and  Pats  [14],  and  Kushner  [12].  The  proofs  of  those  authors  rely  heavily 
on  the  martingale  weak  convergence  theory.  They  are  quite  involved,  on  the  one  hand, 
and  do  not  seem  to  be  easily  extendable  to  more  general  arrival  and  service  processes,  on 
the  other  hand.  In  our  approach  we,  in  a  certain  sense,  return  to  the  basics  and  employ 
ideas  which  have  proved  their  worth  in  the  set-up  of  generalised  Jackson  networks.  We 
show  that  continuity  considerations  may  produce  stronger  conclusions  at  less  complexity. 
Our  main  result  states  that  if  the  network  primitives  satisfy  certain  limit  theorems  with 
continuous-path  limits,  then  the  multidimensional  queue-length  processes,  when  suitably 
scaled  and  normalised,  converge  to  a  reflected  continuous-path  process  on  the  nonnegative 
orthant.  If  the  limits  of  the  primitives  are  diffusion  processes,  the  limit  stochastic  process  is  a 
reflected  diffusion  with  state-dependent  drift  coefficients  and  constant  diffusion  coefficients. 
The  scaling  we  use  does  not  capture  the  case  of  state-dependent  diffusion  coefficients.  We 
also  give  an  application  to  generalised  Jackson  networks  with  state-dependent  rates  thus 
providing  an  extension  of  Reiman’s  [18]  results.  In  addition,  we  bridge  certain  gaps  in  the 
reasonings  of  Yamada  [20],  Mandelbaum  and  Pats  [14],  and  Kushner  [12].  For  instance,  the 
proofs  assume  functions  Aj(-)  and  pj(-)  are  bounded  and  allude  to  a  “truncation  argument” 
for  the  unbounded  case  omitting  the  details.  In  particular,  existence  and  uniqueness  for 
(1.1)  is  not  fully  addressed.  The  key  to  the  extension  to  unbounded  rates  is  tightness 
of  the  processes  in  question.  We  give  a  crisp  reasoning  establishing  that  property  under 
linear  growth  conditions  (see  Lemma  3.1),  which  enables  us  to  prove  both  the  existence 
and  uniqueness  of  a  solution  to  equations  (1.1)  and  the  limit  theorem  under  linear  growth 
conditions.  A  more  detailed  discussion  is  provided  at  the  end  of  Section  2. 

A  different  class  of  results  on  diffusion  approximation  concerns  queueing  systems  modelled 
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on  the  many-server  queue  with  a  large  number  of  servers.  In  such  a  system  the  service  rate 
decreases  to  zero  gradually  with  the  number  in  the  system  (whereas  in  the  model  considered 
here  it  has  a  jump  at  zero,  see  (2. 2d)),  so  the  limit  process  is  an  unconstrained  diffusion, 
see,  Mandelbaum,  Massey,  and  Reiman  [13],  Pang,  Talreja,  and  Whitt  [15],  and  references 
therein.  We  do  not  consider  those  set-ups  in  this  paper. 

The  exposition  is  organised  as  follows.  In  the  next  section,  we  state  and  discuss  our  main 
result.  The  proof  is  provided  in  Section  3.  In  Section  4,  an  application  to  state-dependent 
generalised  Jackson  networks  is  presented.  The  appendix  contains  a  proof  of  the  pathwise 
queue-length  construction  underlying  the  dehnition  of  the  model. 

Some  notational  conventions  are  in  order.  All  vectors  are  understood  as  column  vectors, 
|a;|  denotes  the  Euclidean  length  of  a  vector  x,  its  components  are  denoted  by  Xi,  unless  men¬ 
tioned  otherwise,  superscript  ^  is  used  to  denote  the  transpose,  1a  stands  for  the  indicator 
function  of  an  event  A  ,  dij  represents  Kronecker’s  delta,  [aj  denotes  the  integer  part  of  a  real 
number  a ,  denotes  the  set  of  whole  numbers,  and  S  is  used  to  denote  the  iP-dimensional 
non-negative  orthant  ]R^.  We  use  D([0,  cx)),  iR^)  to  represent  the  Skorohod  space  of  right 
continuous  functions  with  left  hand  limits  which  is  endowed  with  the  Skorohod  topology, 
^  represents  convergence  in  distribution  of  random  elements  with  values  in  an  appropriate 
metric  space,  see  Billingsley  [2],  Ethier  and  Kurtz  [6]  for  more  information.  We  also  recall 
that  a  sequence  V"'  of  stochastic  processes  with  trajectories  in  a  Skorohod  space  is  said  to  be 
C-tight  if  the  sequence  of  the  laws  of  the  is  tight,  and  if  all  limit  points  of  the  sequence 
of  the  laws  of  the  are  laws  of  continuous-path  processes  (see,  e.g.,  Dehnition  3.25  and 
Proposition  3.26  in  Chapter  VI  of  Jacod  and  Shiryaev  [9]). 


2  The  main  result 

Let  (D,  J^,  P)  be  a  probability  space  where  all  random  variables  considered  in  this  paper  are 
assumed  to  be  dehned.  We  consider  a  sequence  of  networks  indexed  by  n  with  a  similar 
structure  as  the  one  described  in  the  Introduction.  For  the  n-th  network  and  for  i  G  IK, 
where  IK  =  {1,  2, . . . ,  iL},  let  A”(t)  represent  the  cumulative  number  of  customers  that 
arrive  at  station  i  from  outside  the  network  during  the  time  interval  [0,f],  and  let 
represent  the  cumulative  number  of  customers  that  are  served  at  station  i  for  the  hrst  t 
units  of  busy  time  of  that  station.  Let  J'  IK  represent  the  set  of  stations  with  actual 
arrivals  so  that  A^{t)  =  0  ii  i  ^  J' .  We  call  A”  =  (A”,  i  E  K)  and  D”  =  (D”,  i  G  IK),  where 
A”  =  [A^{t),t  >  0)  and  =  {D^(t),t  >  0),  the  arrival  process  and  service  process  for 
the  n-th  network,  respectively.  We  associate  with  the  stations  of  the  network  the  processes 
=  (<h”-,j  G  IK),  i  G  ]K,  where  =  (<h”(m),m  =  1,2,...),  and  <h”(m)  denotes  the 
cumulative  number  of  customers  among  the  hrst  m  customers  that  depart  station  i  which 
go  directly  to  station  j.  The  process  <h"  =  (<h”-,i,j  G  IK)  is  referred  to  as  the  routing 
process.  We  consider  the  processes  A^,D'^,  and  as  random  elements  of  the  respective 
Skorohod  spaces  D([0,  ex),  iR),  D([0,  ex),  iR),  and  D([0,  x),  1?^);  accordingly,  A'^,D^,  and 
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are  regarded  as  random  elements  of  D([0,  cx)),  iR^),  D([0,  oo),lR^),  and  D([0,  cx)), 
respectively. 

Let  A”  and  /i”,  where  i  G  IK,  be  Borel  functions  mapping  S  to  iR+,  with  XI  [x)  =  0 
\i  i  ^  J ,  and  let  X^  =  (A”, . . . ,  A^)  and  iX  =  (/x”, . . . , /i^) .  These  functions  have  the 
meaning  of  state-dependent  arrival  and  service  rates.  Let  >  0)  and 

,  f  >  0)  represent  nondecreasing  Z+-valued  processes  with  trajectories 
in  D([0,cx),iR)  and  with  =  iVf’”(0)  =  0.  We  dehne  =  [t\  if  i  ^  J . 

(The  latter  is  but  a  convenient  convention.  Since  XI  {x)  =  0  if  i  ^  JT”,  the  process  is 
immaterial,  as  the  equations  below  show.)  The  state  of  the  network  at  time  t  is  represented 
by  Q"'(t)  =  (Qi  (t), . . . ,  Qxi't)) ,  where  Q”(t)  represents  the  number  of  customers  at  station 
i  at  time  t .  It  is  assumed  to  satisfy  a.s.  the  equations: 


Qm  =Qm  +  A?(t)  +  B”(()  -  £>”((),  (2.2a) 

Ant)  =nA’‘  \nQnn)ds'j ,  (2.2b) 

K 

B”(i)=E  *”■(«”(<)).  (2-2c) 

i=i 

ont)  =/V°”  (^j‘ l^nQ"M)MQ7(,»«}d^)  .  (2.2d) 


where  t  >  0  and  i  G  IK.  As  above,  Q”(0)  G  Z+  is  the  initial  queue  length  at  station  i; 

(t) ,  (t) ,  and  D^(t)  represent  the  cumulative  number  of  exogenous  arrivals  at  station 
i  during  the  time  interval  [0,f],  the  cumulative  number  of  endogenous  arrivals  at  station  i 
during  the  time  interval  [0,  t],  and  the  cumulative  number  of  departures  from  station  i  during 
the  time  interval  [0,f],  respectively. 

Let  P  =  {pij,  i,j  G  K)  be  a  substochastic  matrix,  R  =  I  —  P^,  and  pi  =  (pij,  j  G  IK) . 
We  denote 


Q"(0) 


g-(o) 


'71 

TD,n, 


n 


-^A.n  /  x  ^ 

N,  =(iV,  it),  t  >  0), 

^D,n  ^  ^ 

=(®r(t),  t  >  0), 


n 


<h”([ntj)  —  Pint 


n 


N  =(iv,  \telK), 

-^D.n  /^rrpD.n  . 

N  =(iv,  \ieK), 
T  =($",  ieK). 


We  will  need  the  following  conditions. 


(AO)  For  each  n  E  IN  and  each  i  E  J ,  hmsupj_,,o^  Nf’^(t)/t  <  cxa.s. 


(Al)  The  spectral  radius  of  matrix  P  is  strictly  less  than  1. 
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(A2)  For  each  i  G  JK, 

\f(nx)  +  af(nx) 
sup  sup  ' — Pa — ^ 

neJV  x£S  ^(1  +  p|) 

(A3)  There  exist  continuous  functions  \i{x)  and  fii{x)  such  that 

^  ^  Ai  a;  ,  ^ ^  ^  Pip 

n  n 

uniformly  on  compact  subsets  of  S',  as  n  — )■  cx).  Furthermore,  for  x  E  S, 

X{x)  —  Rfi{x)  =  0. 


(A4)  There  exists  a  Lipschitz-continuous  function  a{x)  such  that 

{y{^/nx)  —  i?p”(vPa;))  — )■  a{x) 

x/n 

as  n  — )■  CX)  uniformly  on  compact  subsets  of  S. 

(A5)  As  n  — )■  X, 

^  (Xo,  IF^,  IF^,  IF^) 

where  Xq  is  a  random  iF-vector,  IF"^,  fF^,  and  IF^  are  continuous-path  stochastic 
processes  with  trajectories  in  respective  spaces  D([0,  x),  iR^),  D([0,  x), -K^),  and 
D([0,x),iR^^^). 

Lemma  2.1.  Let  condition  (AO)  hold  and  ma,Xi^][^sup^^g{\i{x)+fi'^{x))/{l+\x\)  <  x.  Then 
equations  (2.2a) -(2. 2d)  admit  a  unique  strong  solution  Q'^,  which  is  a  -valued  stochastic 
process. 

The  proof  is  provided  in  the  appendix.  In  order  to  state  the  main  result,  we  have  to 
recall  standard  properties  of  the  Skorohod  map. 

Definition  2.2.  Let  -ip  G  D([0,  x),l?^)  he  given  with  A(0)  G  S.  Then  the  pair  {4>,r])  G 
D([0,  x),  M^)  X  ]D)([0,  x),  M^)  solves  the  Skorohod  problem  for  tjj  with  respect  to  S  and  R 
if  the  following  hold: 

(i)  ^(t)  =  ^jJ{t)  +  Rr]{t)  G  S,  for  all  t  >  0; 

(ii)  for  i  G  JK,  (a)  ?7i(0)  =  0,  (b)  rji  is  non-decreasing,  and  (c)  rji  can  increase  only  when  0 

is  on  the  face  of  S,  that  is,  =  0. 

Let  Ds(l0,  oo),  JR^)  =  {ip  E  D([0,  x),  J?^)  :  A(0)  ^  “S'}.  If  the  Skorohod  problem  has  a 
unique  solution  on  a  domain  D  C  ID)5([0,  x),  JR^),  we  dehne  the  Skorohod  map  F  on  D  by 
F(A)  =  4>  ■  The  following  result  (see  Harrison  and  Reiman  [7]  and  also  Dupuis  and  Ishii  [4]) 
yields  the  regularity  of  the  Skorohod  map  and  is  a  consequence  of  Assumption  (Al). 
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Proposition  2.3.  The  Skorohod  map  T  is  well  defined  on  B)s{[0,oo),  and  is  Lipschitz 
continuous  in  the  following  sense:  There  exists  a  constant  L  >  0  such  that  for  allT  >  0  and 
fii,  %l)2  e  Ds([0,  cx)),  ]R^), 

sup  \r{fii){t)  -r{fi2){t)\  <  L  sup  \fii{t)  -  fi2{t)\. 
te[o,r]  te[o,r] 

Consequently,  both  and  rj  are  continuous  functions  of  ip. 


The  Lipschitz  continuity  of  the  Skorohod  map  and  of  the  function  a{x)  imply  that  the 
equation 

X(t)  =  r(Xo+  f  a{X{s))ds  +  M{-)){t),  (2.3) 


where 


K  K 

M,(t)  =  »'yA.(o)i) + (ft  (o)i)  -  E('*w  -  (ft(o)*) . 

i=i  i=i 


(2.4) 


has  a  unique  strong  solution.  For  t  >  0  and  i  G  K,  let  Xfit)  =  Qp(t)/y/n.  We  also  dehne 
X  =  (X(t),  t  >  0)  and  X^  =  {{Xf{t),  i  =  1,2, . . . ,  K),  t  >  0) . 


Theorem  2.4.  Let  conditions  (A0)-(A5)  hold.  Then  X”  ^  X,  as  n  ^  oo  . 


The  proof  is  given  in  the  next  section. 

We  now  discuss  our  results  as  well  as  those  of  Yamada  [20]  and  Mandelbaum  and  Pats 
[14].  Condition  (AO)  is  needed  to  ensure  the  existence  of  a  unique  strong  solution  to  the 
system  of  equations  (2.2a)-(2.2d),  see  Lemma  2.1.  It  is  certainly  fulhlled  if  is  a  re¬ 
newal  process  and  is  almost  a  consequence  of  condition  (A5)  in  that  the  latter  implies  that 
lim„_^oo  X/’"^(nt)/(nt)  =  1  in  probability.  Part  (Al)  is  essentially  an  assumption  that  the 
network  is  open  and  underlies  the  existence  of  a  regular  Skorohod  map  associated  with  the 
network  data  asserted  in  Proposition  2.3.  The  linear  growth  condition  (A2)  is  the  same 
as  condition  (A2)  in  Mandelbaum  and  Pats  [14].  The  requirement  X{x)  =  Rfi{x)  in  (A3) 
together  with  condition  (A4)  dehnes  a  critically  loaded  heavy  traffic  regime.  Condition  (A5) 
is  the  assumption  on  the  primitives.  The  components  of  corresponding  to  i  ^  J  vanish. 
Conditions  (A2)-(A4)  are  fulhlled  if  the  following  expansions  hold: 

X{x)  =  n\i{x/n)  +  y/n\2{x / y/n)  and  fCi^x)  =  nfrfix/n)  +  y/npi2{,x / y/n) ,  (2.5) 

where  Ai  and  pi  are  continuous  functions  satisfying  the  linear-growth  condition  such  that 
Al  {x)  =  i?/ii  {x) ,  and  A2  and  pi2  are  bounded  Lipschitz-continuous.  If  the  above  functions  are 
constant,  then  one  obtains  the  standard  critical  loading  condition  that  (A*^  —  RpC)/ y/n  — )■ 
X2  —  L2  as  n  — )■  CX),  cf.  Reiman  [18]. 

Most  of  the  results  on  diffusion  approximation  in  critical  loading  (see,  e.g.,  Harrison  and 
Reiman  [7],  Kushner  [12])  formulate  the  heavy  traffic  condition  in  terms  of  rates  that  are 


7 


0{1)  and  then  consider  scaled  processes  Q'^{nt)/ y/n.  In  the  scaling  considered  here,  as  in 
Yamada  [20]  and  Mandelbaum  and  Pats  [14],  the  time  parameter  is  left  unchanged  and  the 
factor  of  n  is  absorbed  in  the  arrival  and  service  rates.  This  is  more  convenient  notationally, 
however,  in  the  application  to  generalised  Jackson  networks  in  Section  4  we  work  with  the 
conventional  scaling.  It  may  be  instructive  to  note,  though,  that  if  one  looked  for  limits  for 
processes  Q'^int) / y/n,  then  the  analogues  of  expansions  (2.5)  would  be 

A”(a;)  =  \i{x/n)  +  {1/ y/n)\2{x/ y/n)  and  /i"'(a;)  =  ^i{x/n)  +  {1  / y/n) fi2ix / y/n) , 
whereas  the  assumptions  of  Yamada  [20]  would  amount  to  the  expansions 

X^{x)  =  \i{x/y/n)  +  {1/ y/n)\2{x/ y/n)  and  /^{x)  =  ^i/x/y/n)  +  {I / y/n) ^2{x / y/n) . 


Theorems  1  and  2  in  Yamada  [20]  obtain  diffusion  processes  with  state-dependent  drift 
and  diffusion  coefficients  as  the  limits.  Theorem  1  concerns  the  Markovian  model.  It  is 
required  that  there  be  at  least  one  nonzero  external  arrival  process.  The  arrival  and  service 
rates  at  a  station  may  depend  on  the  queue  length  at  that  station  only.  Theorem  2  concerns  a 
Jackson  network  with  external  arrival  processes  being  Poisson  processes  with  state-dependent 
rates.  In  the  proof  of  Theorem  2,  the  process  di^{t)  claimed  to  be  a  locally  square  integrable 
martingale  on  p.980  does  not  seem  to  be  so,  anyway,  no  justihcation  is  provided. 

The  model  of  Yamada  [20]  is  dehned  by  postulating  certain  martingale  properties  of  the 
arrival,  service,  and  customer  transfer  processes.  No  justihcation  of  this  model  in  terms  of 
the  primitive  processes  is  provided,  nor  is  the  issue  of  the  assumptions  being  self-consistent 
addressed.  This  gap  is  hlled  in  by  Mandelbaum  and  Pats  [14],  although  the  authors  admit 
the  proof  is  missing  technical  detail,  see  p.623  in  Mandelbaum  and  Pats  [14].  On  the  other 
hand,  Mandelbaum  and  Pats  [14]  produce  few  details  with  regard  to  the  existence  and 
uniqueness  of  a  solution  to  (1.1)  under  linear  growth  conditions  on  the  rates.  In  particular, 
it  is  not  explained  how  Theorem  2.1  in  Kurtz  [11]  enables  one  to  establish  Proposition  13.4, 
nor  is  it  spelled  out  how  Proposition  13.4  furnishes  the  proof  of  existence  and  uniqueness. 
The  proof  of  Theorem  2.1  in  Kurtz  [11]  seems  to  have  gaps  too.  Mandelbaum  and  Pats 
[14]  and  Kushner  [12]  allow  the  routing  matrix  to  be  state-dependent.  Mandelbaum  and 
Pats  [14]  appeal  to  Theorem  5.1  and  Corollary  5.2  in  Dupuis  and  Ishii  [5]  to  substantiate 
the  existence  and  uniqueness  for  the  Skorohod  problem,  however,  those  results  are  proved 
for  bounded  domains,  so  they  do  not  apply.  The  authors’  attempt  on  p.628  to  recast  the 
reflection  problem  as  a  time-dependent  reflection  is  unconvincing.  Kushner  [12],  in  their 
proofs  of  Theorem  1.1  on  p.309  and  Theorem  2.1  on  p.318,  relies  on  their  Theorem  5.1  on 
p.l23  and  Theorem  5.2  on  p.l24  which  in  turn  are  based  on  Theorem  2.2  in  Dupuis  and  Ishii 
[4] ,  however,  those  results  pertain  to  reflection  directions  which  are  constant  on  the  faces,  so 
they  do  not  apply  to  state-dependent  reflection  directions. 

Kushner  [12]  does  not  address  the  issue  of  the  model  being  well  dehned  either.  Nor 
are  we  convinced  by  the  substantiation  of  martingale  properties  claimed  to  hold  on  p.310. 
Besides,  the  hypotheses  of  Theorem  1.1  on  p.309  and  Theorem  2.1  on  p.318  of  Kushner  [12] 


are  missing  the  condition  of  the  drift  and  diffusion  coefficients  being  Lipschitz  continuous. 
On  the  other  hand,  the  condition  that  the  hrst  moments  of  the  initial  queue  lengths  be  hnite 
assumed  by  Mandelbaum  and  Pats  [14]  can  be  done  away  with. 


3  Proof  of  Theorem  2.4 


We  assume  conditions  (A0)-(A5)  throughout  this  section.  We  introduce  the  “centered’" 
processes  as  follows:  For  i  E  IK  and  t  >  0, 


(t) 


B,n  / 


rD,n/ 


(3.6a) 


where 


Ay  ”(()  \:{Q''(s))ds, 

K 


jA^n 


(3.6b) 

(3.6c) 


and 


’"(t)  =N^ 


D.n 


Fr(Q”('S))l{Q"b)>o}^'5 


,.i  yjo 


^KAQ'"{s))l{Qr^(^s)>Q}ds 


/i"(g"(s))l{Q»(.)>o}ds  .  (3.6d) 


We  can  rewrite  the  evolution  (2.2a)  as 


Qnt)  =  Qr(o)  + 


K 


A”(Q”(s))  +  5^  Pj.y «”(«))  -  ^(Qys)) 

i=i 


ds  +  (t)  +  [RY^{t)]i, 


where  Y^{t)  =  {Y^{t)  ,i  E  IK)  and 


=  f  l{<3"(.).0)y  ((?”(«))  ds,  i  €  K,  (3.7) 

Jo 

Note  that  (Yl^(t),t  >  0)  is  a  continuous-path  non-decreasing  process  with  h^"'(0)  =  0,  which 
increases  only  when  Q^it)  =  0,  i.e.,  l{Qn(^)^Q|(iY)"-(t)  =  0  a.s.  Let 

a^{x)  =  X^{x)  -  Rfi^{x).  (3.8) 
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Then  the  state  evolution  can  be  expressed  succinctly  by  the  following  vector  equation: 


Q"{t)=Q^{0)+  a^{Q^{s))ds  +  M^{t)  +  RY^{t),  t>0. 

Jo 

It  can  also  be  described  in  terms  of  the  Skorohod  map: 


(3.9) 


l3"(()  =r  (^Q”(0)  +  y  o”(Q"(s))ds  +  M"(.)j  ((),  for(>0.  (3.10) 

The  following  tightness  result  is  essential. 

Lemma  3.1.  The  sequence  of  processes  {M"’(t)/ y/n,  t  >  0)  is  C-tight. 

Proof  By  (2.2a)  -  (2.2d), 


YQi(t)  <  ^or(o)  +  ^^”(i)  =  5;<3?(o)  +  Km>))<is) . 

i=l  i=l  i=l  i=l  i=l  k-'O  / 

Therefore,  for  suitable  H  >  0,  on  recalling  (A2)  and  denoting  Zf’(t)  =  Q'^(t)/n, 

f2  zm  <  E  zno)  +  E  -  Y"(y)  (i  +  /'  iA"(nz”(s))*) 

*=1  i=i  i=i  \  Jo  n  ) 

<  ^  ^r(O)  +  ^  sup  -  il  +  H  f  (1  +  ^2  I  ■ 

*=i  i=i  y^^  y  \  Jo  J 

By  Gronwall’s  inequality  (cf.  p.498  in  Ethier  and  Kurtz  [6]), 

K  K  K  ^  K  ^ 

E  zm  <  (E  zm + E  ®“p  -  E’"(9)(i  +  m)  E  =“p  -  Y"(y)t) . 

i=i  i=i  i=i  y^^  y  i=i  y^^  y 

By  (A5),  N2’'^{y)/y  — )■  1  in  probability  as  y  — )■  cx)  and  n  — )■  cx)  and  '^2iZf'{0)  — )■  0  in 
probability  as  n  — )■  cx  .  Therefore, 


(3.11) 


It  follows  by  (A2)  that 


lim  limsupP 

n^oo 


-  K(Q7U))  +  -  p?(0r(s)))  *  >  0 

n  n 


0 


(3.12) 
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and  that,  for  <5  >  0,  e  >  0,  T  >  0, 


/•t+S  1  1 

limlimsupP(  sup  /  (- A”((5r(s))  +  - /i”((5r(’S)))  ds  >  e)  =  0  . 

(5^>o  n^oo  te[o,r]  Jt  ""  "" 


n 


n 


(3.13) 


We  have  that,  for  7  >  0,  <5  >  0,  e  >  0,  T  >  0,  and  r  >  0, 

P(  sup  \±Mf-’'(t)-J^Mf-’'(,)\>^)<P(r-\ims))ds>r] 

s,te[o,T]:  Vn  Vo  n 


p— 1|<5 


f>t+5 


P(sup  /  -  A”(g”(s))ds  >  e) +P(  sup  |ivf’”(t)  -  ivf’”(s)|  >  7) . 

te[0,T]  Jt  ^  s,te[0,r]: 

|s— t|<e 


By  (A5),  (3.12),  and  (3.13), 


1  1 

-  rA,nu\  A/rAn/ 


limlimsupP(  sup  \—=M^{t) - j=Mf’"'{s)\  >  7)  =  0 , 

n^oo  s,te[0,T]:  v"^  V 

|s— 1|<5 


Hence,  the  sequences  of  processes  (Mj^’"'(t)/yn,  t  >  0)  are  C-tight.  A  similar  argument 
shows  that  the  sequences  of  processes  t  >  0)  and  y/n,  t  >  0)  are 

C-tight,  so  the  sequence  of  processes  y/n,  t  >  0)  is  C-tight.  ■ 

Next,  we  identify  the  limit  points  of  M”  =  {M'^{t)/y/n,  t  >  0). 

Lemma  3.2.  The  sequence  of  processes  M”  converges  in  distribution,  as  n  ^  00,  to  M  . 

Proof.  From  Lemma  3.1,  M^{t)/n  — )■  0  in  probability  uniformly  over  bounded  intervals. 
By  (A2)  and  (3.8),  for  some  H' ,  for  all  n  and  x,  |a’^(na;)|  <  H'n{l  +  |a;|) .  By  (3.11),  the 
sequence  of  processes  (/^  (l/n)a'^(g"'(s))(is,  t  >  0)  is  C-tight.  By  the  fact  that  M'^{f)/n  -A  0 
in  probability  uniformly  on  bounded  intervals,  Prohorov’s  theorem,  and  the  continuity  of  the 
Skorohod  map,  the  sequence  of  processes  {Q^(t)/n,  f  >  0)  is  C-tight  and  every  its  limit  in 
distribution  (g(t),  t  >  0)  satishes  the  equation 

(lit)  =  ^  (^(?(^))  -  Rpiqis)))ds^  (t) . 

Since  by  (A3),  A(a;)  —  Rfi{x)  =  0,  we  must  have  that  q(t)  =  0,  which  implies  that  the 
sequence  Qf{t)/n  tends  to  zero  as  n  — )■  cx)  in  probability  uniformly  on  bounded  intervals. 
By  condition  (A3)  and  (3.8),  (l/n)a”(g”(s))(is  — )■  0  in  probability.  Since  by  (3.9)  is 

expressed  as  a  continuous  function  of  (g”(0)  +  a^{Q^{s))ds  +  M'^{f),t  >  0),  we  have  that 

Y^{t)/n  — )■  0  in  probability  uniformly  over  bounded  intervals,  so  by  (3.7),  for  i  G  IK, 
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1 

n 


/i”(Q”(s))l{Qn(s)=o}(is  -)■  0 


in  probability  as  n  — )■  cx). 


We  also  have  by  (A3)  that 


1 

n 


KiQ^i^))  Aj(0)t  in  probability  as  n  — )■  cx 


(3.14) 


(3.15a) 


and 


1 

n 


ds  — )■  /ij(0)t  in  probability  as  n  — )■  x  . 


(3.15b) 


Since  by  (A5),  N^''^{nt) /n  — )■  t  in  probability  as  n  — )■  x,  by  (2. 2d),  (A4),  (3.14),  and 
(3.15b), 

D^it) 

— - - )■  /ij(0)t  in  probability  as  n  — )■  x.  (3.16) 

n 

The  convergences  in  (A5),  (3.15a),  (3.15b),  and  (3.16)  imply  if  one  recalls  the  dehnitions  in 
(3.6b),  (3.6c),  and  (3.6d)  that  the  / y/n,  / y/n)  converge  in  distribution 

to  where  Ap(t)  =  Hy(A.(0)t),  Mf(t)  =^Ehar*(ft(0)«),  Mf(t)  = 

~  so,  by  (3.6a)  and  (2.4),  the  M”  converge  in  distribution  to 

M .  ■ 


Proof  of  Theorem  2.4.  We  note  that  by  (3.10), 

X”(t)  =r  (^X^(0)  +  ^  ^a”(v^X^(s))ds  +  M”(-)^  (t),  for  t  >  0.  (3.17) 

By  the  Lipschitz  continuity  of  the  Skorohod  map,  (3.8),  and  (A2),  for  T  >  0  and  suitable 

i/  >  0, 

sup  |X”(t)|  <  |X'^(0)|  +  L  [  -^\a"'{y/nX'^{s))\ds  -\ — ^  sup  \M'^{t)\ 
te[o,T]  Jo  te[o,r] 

<|X"(0)|+L77  [  (l  +  |X’^(s)|)ds  +  ^  sup  |M”(t)|. 

Jo  te[0,r] 

Gronwall’s  inequality,  the  convergence  of  the  X"(0),  and  Lemma  3.2  yield 

lim  hmsupP(  sup  |X'^(t)|  >  r)  =  0 , 
r— Aoo  n^cx)  te[0,r] 

SO,  by  (3.8)  and  (A4),  the  sequence  of  processes  d^{y/nX^{s))  /  y/n  ds,t>0)  is  C-tight. 
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By  (3.17),  the  convergence  of  the  X"'(0),  Lemma  3.2,  (A4),  Prohorov’s  theorem,  and  the 
continuity  of  the  Skorohod  map,  the  sequence  of  processes  (X”(f),  f  >  0)  is  C-tight  and 
every  limit  point  t  >  0)  for  convergence  in  distribution  satishes  the  equation 

X{t)  =  r  (^X(O)  +  ^  a(X(s))ds  +  M(-)^  (t),  for  t  >  0. 

The  uniqueness  of  a  solution  to  the  Skorohod  problem  implies  that  X(t)  =  X (t) .  ■ 


4  Generalised  Jackson  networks  with  state-dependent 
rates 

In  this  section,  we  consider  an  application  to  generalised  Jackson  networks  in  conventional 
scaling.  Suppose  as  given  mutually  independent  sequences  of  i.i.d.  nonnegative  random 
variables  >  1},  {vl{n),i  >  1}  for  j  G  C  and  k  G  IK.  For  the  nth  network, 

the  random  variable  n*(n)  represents  the  ith  exogenous  interarrival  time  at  station  j,  while 
n^(n)  is  the  ith  service  time  at  station  k.  The  quantities  pij  represent  the  probabilities  of 
a  customer  leaving  station  i  being  routed  directly  to  station  j,  which  are  held  constant. 
The  routing  decisions,  interarrival  and  service  times,  and  the  initial  queue  length  vector  are 
mutually  independent. 

We  define 


hfc  =  (E[nfc(n)])  ^  >  0,  sl  =  Var(n^(n))  >0,  k  e  K,  and 

Xj  =  (E[M](n)])“^  >0,  a”  =  Var(M](n))  >0,  j  G  J, 

with  all  of  these  terms  assumed  hnite  and  the  set  nonempty.  It  is  convenient  to  let  A”  =  1 
and  a”  =  0  for  j  ^  . 

Let  =  max{F  :  <  t}  for  j  e  J  and  =  max{F  ;  ^ 

t}  for  k  E  IK .  We  may  interpret  the  process  f  >  0)  as  a  nominal  arrival  process 

and  the  random  variables  vKn)  as  the  amounts  of  work  needed  to  serve  the  customers. 
Suppose  that  arrivals  are  speeded  up  (or  delayed)  by  a  function  A”(a;),  where  i  G  J7,  and  the 
service  is  performed  at  rate  where  k  G  IK,  when  the  queue  length  vector  is  x.  As  in 

Section  3,  we  let  =  [fj  and  A"(a;)  =  0  for  i  ^  J7.  In  analogy  with  (2.2a)-(2.2d)  the 

queue  lengths  at  the  stations  at  time  t,  which  we  denote  by  Q^(t),  are  assumed  to  satisfy 
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the  equations 


QW)  =0”(0)  +  i”(i)  +  4”(i)  - 

'Kmsnds'j , 

K 

h"(i)=E*Mh"(‘)). 

j=i 

A”(*)  =A°'”  (  rAr(Q"(i>))i|0..(.,>„,<ii>)  . 


where 

m 

*S(“)  =  EA.W. 

i=l 

with  {(Xji(O)  *  =  I  =  1,2,...}  being  indicator  random  variables  which  are 

mutually  independent  for  different  j  and  I  and  are  such  that  P(xA(/)  =  1)  =  pji . 

If  we  introduce  the  random  variables  Q^{t)  =  Q^{nt),  A'l{t)  =  A'^{nt),  B^{t)  =  B^{nt), 

Dm  =  =  mm/K),  rfpm  =  nm  =  *”.(>"). 

and  functions  \^{x)  =  n\^\^{x)  and  p.^(x)  =  njJ^pi^^x),  then  we  can  see  that  they  satisfy 
equations  (2.2a)-(2.2d).  Condition  (AO)  holds  as  — )■  1  and  — )■  1  a.s.  as 

t  m  oo . 

If  we  also  assume  that  Q'^{0)/y/n  =m  Xq,  that,  for  k  &  IK  and  j  G  J, 

/ifc,  S'l  — )■  Sfc, 

A”  — y  Xj,  cij  — y  cij, 


as  n  — )■  cx) ,  and  that 

maxsup  E(u^(n))^’'"'^  +  maxsup  <  oo  for  some  e  >  0, 

k^JK  72>1  3^'^  n>l 

then  condition  (A5)  holds  with  =  ^JajXjBf  for  j  e  J,  W^{t)  =  0  for  j  ^  J,  and 
Wj?  =  ^/skjJikB^  for  /c  G  iA ,  where  Bf  and  Bj^  are  independent  standard  Brownian  motions, 
with  being  a  A-dimensional  Brownian  motion  with  covariance  matrix  Fi^ik{t)^ij{t)  = 
{pij^jk  —  PijPik)t,  and  with  processes  B^,  Bj^,  and  being  mutually  independent. 

Let  us  assume  that  the  following  versions  of  conditions  (A2)-(A4)  hold: 

(A2)  For  each  i  G  IK, 


sup  sup 

n£]N  x£S 
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(A3)  There  exist  continuous  functions  Xi(x)  and  jUi(x)  such  that 

\^{nx)  — )■  \i{x),  fi^{nx)  — )■  fii{x) 

uniformly  on  compact  subsets  of  5,  as  n  — )■  cx).  Furthermore,  for  x  E  S, 

X{x)  —  Rjl{x)  =  0, 

where  Xi{x)  =  XiXi{x)  and  ]Ii{x)  =  iiijli^x) , 

(A4)  There  exists  a  Lipschitz-continuous  function  a{x)  such  that 

\/n{X^  {y/nx)  —  Rjl"'{y/nx))  — )■  a{x) 

as  n  — )■  cx)  uniformly  on  compact  subsets  of  S,  where  X^{x)  =  X^X^{x)  and  = 


Then  the  process  M  in  (2.3)  and  (2.4)  is  a  iF-dimensional  Brownian  motion  with  covari¬ 
ance  matrix  A  which  has  entries 


K 

-Aii  =  Ai(0)Afai  -h  /ii(0)/ifsi(l  -  2pii)  ^  -  pji  -h  Pjip]sj)  for  i  E  IK, 

i=i 


and 


A- 


K 

Pi  SiPij  Pj(0^p,jSjPji  -|-  ^  ^ /ffc (0)/^fcPfciPA:j (1 

fc=l 


for  1  <  f  <  j  <  iF. 


An  application  of  Theorem  2.4  yields  the  following  result. 

Corollary  4.1.  If,  in  addition  to  the  assumed  hypotheses,  condition  (Al)  holds,  then  the 
processes  {Q^{nt)/ y/n,  t  >  0)  converge  in  distribution  to  the  process  {X(t),  f  >  0)  with 

X{t)=T(^Xo  +  d{X{s))ds  +  A^/^B{-)){t), 

where  B{-)  is  a  K -dimensional  standard  Brownian  motion. 

Remark  4.2.  The  conditions  on  the  asymptotics  of  the  arrival  and  service  rates  essen¬ 
tially  boil  down  to  the  assumptions  that  the  following  expansions  hold:  X  {x)  =  Xi{x/n)  -\- 
X2{x / y/n) / y/n  andjR^x)  =  p.^^{x / n) -I  Jl2{^ / V^) / suitable  functions  Xi,  X2,  Ri,  and 
p2- 

Remark  4.3.  If,  in  addition,  the  assumption  of  unit  rates  is  made,  that  is  Xf{x)  =  1  for 
j  E  J  and  p^{x)  =  1  for  k  E  IK,  then  the  limit  process  is  a  K- dimensional  reflected 
Brownian  motion  on  the  positive  orthant  with  infinitesimal  drift  a(0)  and  covariance  matrix 
A,  and  the  reflection  matrix  R  =  I  —  ,  as  in  Theorem  1  of  Reiman  [18], 

Remark  4.4.  In  order  to  extend  applicability,  one  may  consider  independent  sequences  of 
weakly  dependent  random  variables  {Kj{n),i  >  1},  {vl{n),i  >  1}  for  j  E  J  ‘T  IK  and 
k  E  IK.  Under  suitable  moment  and  mixing  conditions  which  imply  the  invariance  principle, 
cf.,  e.g.,  Herrndorf  [8],  Peligrad  [16],  Jacod  and  Shiryaev  [9],  Corollary  4-1  continues  to 
hold. 
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Appendix 


Proof  of  Lemma  2.1.  The  proof  is  an  adaptation  of  the  one  in  Puhalskii  and  Simon  [17, 
Lemma  2.1]  and  employs  the  approach  of  Ethier  and  Kurtz  [6,  Theorem  4.1,  p.327].  Let 


e^{x) 


1^7  (x) 


1  +  +  \m) , 

i=l 

e^{x)  ’ 


and 


=  inf{s  :  /  9'^ {u))  du  >  t} 


We  note  that  is  hnite- valued,  differentiable,  dT'^{t)/dt  =  l/d^{Q'^{T^{t))  and  T^{t)  —)■ 
cx)  as  t  — )■  cx) .  One  can  see  that  if  the  process  satisffes  a.s.  the  equations 


Q7it)  =  Q7io)  +  Nf’i  X7iQ^is))ds 


K 


rtf 

Z % (<■” ( / 

j=l  do 

W(  f  A‘rW”(s))lw»(.>0)*)  £  0. 


(Al) 


then  the  process  =  {Q"'{t)  ,t  >  0)  deffned  by  =  Q”(T"'(t))  satisffes  a.s.  the 

equations 


A,n 


QW) = «r(o) + Ni 

t=i 


K{Q^{s))ds 


hi(<0"(s))l{Qn(,)>O}C^S 


-iV„ 


D,n 


(A2) 


On  the  other  hand,  suppose  a  Z:^-valued  process  Q”  satisffes  a.s.  (A2)  and  let 

1 


f^{t)  =  inf{s  : 


/o  0"(g"(M)) 


du>  t] . 
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We  show  that  is  well  dehned  for  all  t  a.s.  Since  by  hypotheses,  for  a  suitable  constant 
L"-,  9'^{x)  <  L”(l  +  x),  we  have  that 


r  1  ,  1 

/  - ^ - du  >  — 

lo 


>0  1 +  E'h  ^ 

where  the  latter  inequality  uses  the  fact  that  by  (A2) 


du>  — 


0  1  +  EH,  Q?(o)  +  Eti  «■/*•”(«) 


K  atAu/ 


du, 


(A3) 


K 


K 


K 


Qnt)  <  E  ^"(0)  +  E  /  kiQUu))  du) 


i=l 


2=1 


2=1 


and  that  A”(a;)  <  1.  Since  limsup^^o^  <  oo  a.s.,  the  rightmost  integral  in  (A3) 

tends  to  inhnity  as  t  — )■  cx)  a.s.,  so  does  the  leftmost  integral,  which  proves  the  claim.  In 
addition,  is  differentiable,  df'^(t)/dt  =  and  — )■  cx)  as  f  — )■  cx)  a.s.  It 

follows  that  satishes  (Al)  a.s. 

Thus,  existence  and  uniqueness  for  (Al)  holds  if  and  only  if  existence  and  uniqueness 
holds  for  (A2).  The  existence  and  uniqueness  for  (A2)  follows  by  recursion  on  the  jump 
times  of  Q"'.  In  some  more  detail,  we  dehne  the  processes  =  (Q”’^(t),  t  >  0)  with 
=  {Qi’\t),  i  =  1, 2, . . . ,  AT)  by  =  g”(0)  and,  for  £  =  1,  2, . . .,  by 

Qfm  =  Qm + A’"(^'  AQ^-'-HAds) 

+  Y.  A.  (<'"  (  f  .,>„,*)) 

j=i  Jo 

-  W(  f  A”(Q”’'-'(s))l|g...-.(., >„,<;*>) . 

V  0 


Let  represent  the  time  epoch  of  the  £th  jump  of  with  r"’’^  =  0 .  One  can  see  that 
=  Q"'’°(0)  if  t  <  .  It  follows  that  t  >  0)  and  t  >  0)  experience 

the  hrst  jump  at  the  same  time  epoch  and  the  jump  size  is  the  same  for  both  processes,  so 
^n,i  ^  ^n,2  A  for  t  <  .  We  dehne  Q^{t)  =  Q^{0)  for  t  < 

and  Q^{t)  =  for  <  t  <  .  Similarly,  for  an  arbitrary  £  G  IN,  we  obtain 

that  and  A  r”’^)  =  for  t  <  .  We  let  Q^{t)  = 

for  <t<  .  The  process  Q"  is  dehned  consistently  for  t  G  r”’^) .  If 

^n,i+i  _  ^  some  i,  then  we  let  Q^{t)  =  for  all  t  >  r'^’^ . 

Suppose  that  <  cx  for  all  i.  Then  Q"'{t)  has  been  dehned  for  all  t  <  = 

lim^^oo and  satishes  (A2)  for  these  values  of  t .  We  now  show  that  r"’°°  =  cx .  The  set 
of  the  time  epochs  of  the  jumps  of  Q”  is  a  subset  of  the  set  of  the  time  epochs  of  the  jumps 
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of  the  process  Q”  =  t  >  0),  where 


<3”(i)  =  (iv/^”  ( /‘  A“(0"’'-'  (s))dA+f2i],  (<•” 

i=l  ^  j=l 


^n/An,£-l 


Since  the  process  has  inhnitely  many  jumps,  so  does  the  process  Q”  •  Since  X^{x)  <  1, 
p”(a;)  <  1  and  <h”j(mi)  —  <hjj(m2)  <  nii  —  ^12  for  mi  >  m2,  the  lengths  of  time  between  the 


jumps  of  are  not  less  than  the  lengths  of  time  between  the  corresponding  jumps  of  the  pro- 
cess  (Ei.  iV^’"(«)  +  E'h  «  >  0)  .  The  process  (Ei.  iVfE*)  +  Efl. 

0)  having  inhnitely  many  jumps,  the  time  epochs  of  the  jumps  of 
t  >  0)  tend  to  inhnity  as  the  jump  numbers  tend  to  inhnity.  Thus,  =  00  a.s. 


The  provided  construction  shows  that  Q”  is  a  suitably  measurable  function  of  N^’^, 
and  <h"',  so  it  is  a  strong  solution.  We  have  proved  the  existence  of  a  strong  solution 
to  (A2) .  A  similar  argument  establishes  uniqueness.  ■ 
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